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This docijnient smmnariges in nosi- technical terms the prelimina^ policy-relevant 
fliidlngs of a aatioiial evaLuation of the Emergency SchODl Aid Act (ESAA) Basic 
and Pilot Programs dicing the second ^ear of prograCT operations, L974-75* It is 
iiitended to provide an overviev/ of the results reported in two larger and mora 
detailed Gumpanion volimas prepared fee the D,S. Office of Educatiori by System 
Dsvelopmeiit CoEjoratioii* * An attempt is also inade ±n thim volxme to relata the 
seG^nd-^year results to findinis in the first, evaluation year, 1973-74, It is 
stMngly reeonm«nded that interested ^^eaders eKMiine the cited reports^ which 
provide a mnah wore detailad pictiare nOC the ESAA pragram and its ^ effects than 
caa possibly ba provided in the preseiit abteeviated docuinent. I« particular, 
thft materials rafarenead abova descrite the study's resaarch metjiQdology and 
present data upon which aJL of the evaluatioa findings, not s imply- tha highlights 
^unonarizad balow^ are iDased, Also recomended for review by int ares ted readers 
is a doctiment**^ produced in coiij unction vlth the BSm evaluation, describing 
SDC's restandardization of an existing stajidardiged aGhievement teat on the 
tasie of data collected from stadents enrolled in a nationally representative 
samj^la of minority-^isolated scliools. 

h major objective of the study, as initially defined by the U.S. Office of 
Edacation, has bean to assesB the overall inipact of the ISAA Basic aad Pilot 
programs on students * aGademic skills and on certain desegregation-related 
outcome measures. Accordingly , results of litipact amlysas are reported in 
this docximant. However^ it has been apparent from the earliest stages of data 

*Coulson, J. E, j Oaema-, D. , Bradford, C*, Doherty^, W, J., D\xck, G, A., 
Henianway, J. A, , arid Van Gelder, C* ^he Second ^ear of Emarg ency School 
Aid ^ct (ESAA) implemeritation , System Development Corporation, 

July 1976 • " 

Wellisch^ J. B* , Marcus, A. C* , jMacQuaen^ H, , and Duck, ftn In-Depth 

Study- of EJnergenc y School Md Act (ESAA) Schools^ 1974-75, TM-- 5 236/0 10/00, 
System Developmeiit Corproatlon, July 1976 • 

**0^enna# D. G. , Van Gaidar, N. C*, ajid Cohea, k. J* Emergericy School Aid Act 
(ESAi^) N ational SvaluatioJ^f Achiev emerit ^est: Restandardiaiation , rM=S236/O06/0O, 
Sy s tern Development Corporation , Novemlier 1974. 
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collection that the results of any such overall impact st-udy would almost 
certainly be diffiault to interpret because of the wide variations found among 
local ESAA projects with respect to speclfia project goaLs, approaches ta.kBri 
to reach these goals, and the magnitude and qualitF project resources applied 
to the goals. In such an evaluation, the deficiencies of sonie projects my 
obscure the successes of other projects. Accoidingly, this report placea con-- 
sideraile emphasis on the Identification of elements or characteristics of the 
school programs that seem to have helped diaadvantag ed Btudents , regardiass of 
tile source of funding for those proga 
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^ATIONAl EVALUATION OF OTE EI^IERGMCY SCHOOL HID 
MT (ESm)i SUMM^W OF ME SECOND-YEAR STUDIES 

Jn conjiincti&n w^ith and under cMtracts ftom the U,S. Office of Education , 
S/stam Dey^el^praent Corporation (SDC) is Ganducting an ev^aluation of two closely 
ralatadl pto^iraQiS authorized under tlie Bttargcncy School Aid Act {ESM)-=the Basic 
and PlLot Giants progranis. Th.m Basic Program li a deseg relation assistance pro- 
gram in \^hich grants are awarded to mllqible «BChool districts to ancouraga the 
reductloji miaorl ty-group iaaLatica/ to m^et the special neads iriciaent to 
the elimlnati-Oci of segregation dlicrimiiiatlon^ and to assist elaitientary and 
sacondary scKoaL children in ovarconiLng the aducational disadvantages assooiatad 
yiLth wlnoirity^-group isQlatioii. Baslo Grants may be awarded to any Local Education 
Agency (ISA) that (a) ±b implettiMtlrig a desegregation plan or lias adopted and 
ml3 linplein^rkt suah a plan if assistance Is made availdole; or (b) has a plan 
to enroli ncri-^esident □hildran in its schocis to raduce minority-group isola^ 
tion; or (c ) has no desegregation plan but has minority-grQup student enrollrcient 
exceeding 50 percent^ provided that the LEA. eitablishas or maijitairis at least 
one intagtated school* 

la CDiitrast to Basic Grarits , Pilot J^roiect grants are avrarded to LEAs for un- 
usually jroinlilag projects designed to overcome tha adverse effects of nrtinority- 
group iscla-tlon by improving tha acadatriic achie^/ement of children in minority'- 
isolated soliools (i .e* , schools ^±th 50% or greater mlnDrity aurollmeat. To be 
eligible for a Pilot Grant, an LEA xnust be Implementing a desegregation plan m 
a plan to r^ducfe niinorlty-group Isolati&n that TOuld inake it eligible for a 
Basic Grant, 3a addition^ at least 15^000 nlnority-groiip students must be en- 
rolled ill tlie schoDls of the LBKf oi miaority-group students must constitute 
more tha^ 50 percent of the total UBh earoUffient, . 
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Bie confined Basic/Pilot evaluation involves the coliactlon of data G^er a 
pe^Loa of three school years i 1973^74, 1974-75, and 1975^76. ^ previous 
port* d€scribed the evaluation resulta for the first year a973^74>. The pres- 
Qj^^ report describes evaluation results far the second ci-aluatim year (1974-75) 
and also dlBcussas longitudinal findings for the combinea fixst tm ^ears. A 
suDpseqiient report will ptesent results for I975--7G, m well as cumulative trends 
ov^ac the thrae-year period, 

Wox fh^ Year Orie Rapora^ tha only available criterion measures cff prcgram sue- 
caiS vare students* r.corea on standardised achieveiTient tsst.^ in reading and 
mtheina-tics. In 1974-75^ increased empha^sis was placed on demagregatioii'-related 
activities and outcome measurei , Specif icallyf achieveTnant test scores wera 
stipplcnientea by indicators of daBegregation-related school ollniata, ALbo used 
ms a third type of pTOgraiti outcome measure based on ininority-gTOup iaolation 
data collected by the Office of Civil Rights* 

•The oi;erall design of the combined Basic/Pilot evaluation involves tlie collec- 
tion cf cvsiparabla prog-ram and outcome data in both treatment (ESA^- funded) and 
eontrcL <ncn-ESA^) schools* TO select the treatmant and coatrol achools^ pairs 
off siinilar schools v^eia Identified In sample BSM districts; mm mertLber of aaoh 
selected pair was randomly aisigned to the treatment condition aiid tlie other to 
tlia control candition , Sample students were then drawn randoml^^ across classes 
In each sample school in grades 3, 4, and 5 in the elamtntary ichiodls (Basle and 
lilot saniplas), and gmdes 10, 11^ smd 12 in the sacondary schOoLs (Basic sample 
omly) . Ohis ev^aluatiork deaign made it possible to conpara two groups of schools 
(treatment and control) that vera matched in all important characteriBtics ex-- 
aminad esicept those associated ^ith the award of ESAA fund^ to th.i treatinant 
sohools, ^a could then detemine %r^hether the two sets of sohoolg---one receiving 



^Coulson, J. e7* Ozenne^ D, G., Vsltx Galder^ Inuauka, D.^ Bralfordi. C. , 

and Doherty^ J. First Yeay of Emergency School Aid Act (ESQ) Implameii" 

tation, TM-SSSe/OOS/OO, System Devalopmant Corporation ^ September ^ 197 5* 
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ESAA funds and the other not receiving such funds— showed cerr<ispondirig differ- 

enees in rasource allocation, in services offered to the students, and in edu- 
cational appioaches. Only if fluch program diffej-ances were founds would wa 
expect difearances in outcoine (e.g.. In student achievement gains) for the 
traatment and control schools. 

AahievenieMt tests and school elimate instrunienti were administered to sample 
students naar the beginning and end of the sGhool year. In addition, question- 
naires were administered to superintendents, ESAA coordinatorB , district busi- 
ness managers, principals, taaohers, and stuaeiita in ttie spring to obtain data 
on district, school, and program charactBriatics , and on background character- 
istics of st-udents and school personnel . 

The samples for 1974-75 (ESAR-funded treatment schoola plus non-ESAA control 
schools) included 44 Pilot Elementary Schools, 70 Basic Elementary Schools, and 
38 Basic Secondary Schools in 78 BSAA-fmded school districts. Both pretest and 
posttest data were available for a total of 17,297 students in grades 3 through 5 
and 10 through 12. The longitudinal saiiiples (districts, schools, and students 
in the sample for both 1973-74 and 1974-75) . included 26 Pilot Elementary schoolB, 
70 Basic Elementary schools, and 22 Basic Secoiiaary schools in 61 ISAA- funded 
districts; the total nunier of students in these samples was S,S93. 

CHARACTERISriCS_ OF SAMPLE DISTRICTS AND SCHOOLS 

toout half of the ISAA Basic Elementary and Pilot Elementary sample districts 
in 1974-75 were located in the Southeast and South Cantral portions of the coun- 
try, while the Basic Secondary sample was even ffiore heavily distributed (almost 
70%) in those two areas. This geographic ais|ribution corresponds roughly to 
the distribution of the 1974 award universe, i.e., of the total set of districts 
racaiviiig ISAA Basic and Pilot grants in 1974* 
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sample ESAA districts had relati^^ely large jproportions of economiGally disad- 
vantaged students I as indioated by the percantages of students sufficiently 
disadvantaged to be eligible for Elementary and Secondary Education Act (ESEA) 
Title I services. These percentages ranged from about 30% for the Basic Elemen- 
tary and Basic Secondary samples to around 40% for the Pilot Elementary sample. 
Overall, distriots with tha highest percentages of such students were in the 
Southeast and the South Cwtral sections of the nation* 

ESAA Basic sample districts tended to ba urban, with around three-fourths of 
the districts located in a city or toym, and only around 10% in rural coranuni-- 
ties* Around 60% of the Basic Elamentary lample districts and a third of the 
Basic Secondary sample districts were in aities with populations of at least 
50,000; and many were in cities of over 200,000. The Pilot sample was alightly 
less urbanised, with one-fourth of the sample located in rural areas; even here, 
however, about half the Pilot districts v?ere in cities or towns* 

Reflecting their predominantly urban .nature , most sample Basic districts were 
fairly large i the typical district in the Basic Elementary sample had an enroll- 
ment of 8,000 to 50,000 students^ while most districts in the Basic Secondary 
sample had enrollments from 20.000 to 50,000 students. Pilot sample districts 
tended to run somewhat smaller, with a median enrollment of around 8,000 students, 

Most of the sample distriots had achieved a substantial degree of desegregation 

m 

prior to the initial awar^ of ESAA grarits in 1972, That is, the racial/ethnic 
mix of students in each sahool tsiidea to match fairly well the racial mix aver- 
aged acrosa the entire district.* Furthermore, with regard to Black and White 
students, at least, the degree of racial balance in the districts receiving 
ESAA grants was clearly superior to that In a survey of almost half the nation's 



*It is important to note that the deaegragation indices used in this study simply 
reflect, at a fairly groiS lavel, the distriot/school racial balance. They do 
not provide a picture of the status of school integration, in terins of inter- 
personal interactions or attitudaa. 
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districts, conducted by the Office of Civil Rights in 1972. Thim is a highly 
positive finding in one respect. It indicates that, quite appropriately i ESAA 
grants were typically awarded to districti that had already desegregated to a 
considerable extent, and were presumably used to help the districts meet needs 
incident to t)^ desegregation. However, this finding also means that there 
was little room for further improyement in racial balanse after the grants 
were awarded (although a few districts did show reductibn in minority isolation 
during the evaliiation period) . Thus, reduction in minority isolation did not 
prove a useful outcome for assessing ESAA progrem impact. 

Basic Elementary schools had about 45% minority students, while the Basic 
Secondary schools had 35% minority enrollment. Pilot Elementary schools, 
according to ESAA eligibility requiremen-ts ^ were in districts that met Basic 
Grant requirements and were desegregating (or at least had a plan for desegrega 
ting). Pilot-eligible schools also had to have at least 50% minority students; 
the Pilot SMple schools had an average minority enrollment of 82%* 

Minority representation among staffs in the sample schools was consistently 
lower than that among the students. The largest deviation was in the Pilot 
Elementary sample, where 66% of the students were Blacky but only 40% of the 
schools* staff members were Black, 

In sample schools, as in the sample districts overall, the percentage of disad- 
vantaged students in the Pilot Elementar;y schools (i^e*^ minority-isolated) was 
generally higher than that in the Basic Elementary schools (i.e., desegregated) 
About 57% of the students in sample Pilot Elementary schools were reported 
eligihle for ESEA Titj.e I services, while the corresponding percentage for 
sample Basic Elementary schools ^as approximately 44%. Both of these figures 
are higher than comparable district-levsl percentages, suggesting that ESAA 
funds were selectively targeted to the more economically disadvantaged schools 
within the ESAA- funded districts. 
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in all thiree of thm major a974-T5 samflos, minoiity students parceivad them- 
selves as Iss-s CavoraJly tiea-tad by s-ehool admjjiistrators than did mn- 
miftdsit? staaents. In tha Baaic SecoMary sclio«i saraple, however, mnorlty 
stuaerits hiaa ffloEs iavor»bLe pfrcsp-tio-ni thaJl dtd non-minority studeants o£ thi 
teacliers' interactiorks v^i'tli tTie stijaBMs, 

S OTDI^rr, CHAR^CTSRISTICS hm_ WEEPS 

ApprcKiJateXy tv<o-thi.rds ol the iampLe stuaents in sample Pilot Elonentazry 
sGhools (i.e,, CTinotity-iBclfctea s«ho-oi«) were Black, 15% ware Spanish-background, 
and 14% were Hhdte . By ooiitiragt, sll,ghtly motm than half the stiiaeiits in Basic 
Elaiti€nt;ary (desegregated) sotmools -wer-e White, anottisr two-fifths Ma:re Black , 
ana Spanish~teacftgr«und studermts aocoi*itea for aibou* 10% of the samplB. Of the 
BaaLc SeconeSary saanple stiider»ts, aloiJt 59% wete Vhita, almost 4Q% were Blaqk, 
ana less thari 2 ^ wera SEan.iahi-baelc^r»Uiid. 

Aecoiaing to the reports of the tftacrtsrs, only abowt 40% of the parents o! 
sample students ha.d coinlletea high icShoejl, anfl fw«r than one-ftfth of the. fatJiers 
had completea college. PiarthirCTori, a latge perce»tage of parents vera though-t 
by the teachers to have u»sk£lLed jotes. ftlthough -the rfecuracy of the teachers' 
informaticsn niay be ques-tionea, at appaaM Eeaaonabay certain that the sample 
stuaents -mrm economleaaiy as w«13. afl educatiorialL^ disadvantaged. On the 
a'varage, lower ^ocioeooMmie la*vtl.s v?ar« eapottid lor students til minori-ty- 
iaolated ashools, and f -or linority scud«nta regaraiass of their schooli' 
desegrega'tioii m tatiis , 

Malyses cf 197 3-74 ani 1974 -75 ESAA. ev^aluatloii da-ta clearly inaicated that 
studan-cs in aasic and pilot Ero-gmm school dis*rtets had aaute niadi lor coin- 
pensatory eanica-tion sarvicas* a,s evidaftcid by thaLi scores on thi standaraLzea 
achlevameait -tes-ta , an both seaJs , for ixample , average scores on the reading 
3Jid nathemticsi teat aaministir ed near the be^inntng of the school term rangea 
tfrora tJia IStli to the 37th peKoantlle . Vie%jing th^se results in teEms of the 
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fcesc p-ublishers' natjuonal norms, the typi^cal ESAA. stmaents' jper-fo^mamee im2l 
fcj«low that of almost BO«o«the iiattlon's st^deiits ir» the grade levels otf 



Of Che three racial/athriic groups with tt%s aar^es* n,\iiitoerfl oi studan-ts An -the 
evaluation aamples (Black, Whits, and Spanish-lacftground) ^ MJiifcss gasieralL^f 
achieved the highest average test scopes ^ iri bcth 1973-14 an^ anfl 
fior both the Basic and Bilejt Programs- mvmitMlmmi Whiti atiadartts on th* 
average had test sco:ces consistsntly fallow the na.-tiOTal a^aragw, Th«re was 
little evidence in tha test rBsUlts irttaiactiom toitv^sejn ■cci.oecoricmi c L^vel 
and race , or between sea aiid race. Fmales . aaid students of ha-ghet socaoo-co- 
nomac level, tended to have higher pretest acoMs r^gaEdless off race . 

m*aged across racial/ «th3iie gKouEs , elainejita.ry ^tadents in. aesegr&gated 
(Basic Program) ichools ah-owed less seva^a acadamic needs (i.e,, aeh.ievea 
nigEier pretest scores) thaJi students in iniricrLty- isoUtid (Pilot Srogra.ffl) 
schooLs. However ^ tnls di fference , f cund iii b-oth ^ 1^^ and 1974-7 5, was 
largely a f wction o« diff erencea in lacAaL/ettaj. o coni50siti.on of the Basic 
and Pilot samples, and ^ more meaning ful conpa-ris on can b« obtained by ^xa-m- 
inisig minority and naii-mn.or±ty sttJdeaits sejacate ly ^ 

Theie was little disEar it^r in the jretas* sooris of mLnotitsr s-cuaents la dle- 
sagjegated and minority -isolated schools j Lii tooth; enviaronanents , minoritrj stu- 
dents at a given grade laurel and for a given wubtesC hai ^bout th« same per- 
centile mnUnq. By contrast, non -mi flordtir ateua^nts ill d esegregateca 
Bade aubstaiitialli^ higher average test scores thwn non-miaioEit^ stuaent s 3_n 
mnority-isolated sclioola. As a generaL rmle^ ir» fact, tie test acoras o£ 

-minority students in rninority- isolated (Piloc) elefflan taKy achcols fc inaed 
to be closer to thos* ctI ■chair CTinori-ty jeers in thcsa saaie sctiools tha-n to 
the scores of their TOr^-mi-noritj^ counteriarts in deaagiag-atad (Baaic El ementary ) 
schooas. Althougli tliis finding does not neBesiatily imply a causal relatioiiahij 
ietween ichool deaeg legation status and protest periorTOn.ce of the non-minority 
sttfiderits, it is an tJitsresting cbB6r\ration In its own right. 
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la Pt-scsil Vew (seeand year of the e^aLyatiom), tQiaL iwnam pbligated 

aa^ionally foi the ESBA Easdc ana Pilo^ Fio^ranns w^are alo^t S135 rraillLoii aaid 
S34 iriillion, Mspec?tivel5, toe cor^asEoridt^g ClgtJres ff-cr the programs irm 
Fiscal ^ear L 67^ were $L56 million snd 527 r^ilXiorm, mi at theae nati^al aUc^- 
caniOTs mmnt to t^a inddyl^ual school receiving BBaB runas can belt be se^n 
im ttma ^abae lelow^ vrhlcJi siows Cor scJio&ls in th^ 1974-75 aampies tine toWl 
pe^-pupil tfuri^ing, and tJa^ je^-piapiX fiinaing deriwd from ESfiA -grants, iro^ 
DtOieir '(riori--ESM> suppleMnMl pragrsms i ana from cegtalaJ aisfci^t _e}ceiri4it\ir^s, 
TMse f iguMs represent a^^eJages across all ESJ^-fiuji^ea (teeatffnentj achcols 
us'€d in the stuay^^ litipact anslyais™! , all ESm-EartiGlpatt3ig scHdoIs in 
th a samples fcr v/hich. th^re were matched no^^ESAA (cantroD school,!, 

per-ffupil Furtdirig in Sample ESi\A.-Parti.ci5atiing Schools in 1974--75 



^ynding Source 


E^al^jation SMp^a 


3a&-ic ilemeintaiy 


Bagid SiGOnaary 


PI lot E3ein€ntary 


taon-^ES^a Supplemental 
^igula^jr 


puo (ia%) 

$1051 (8^1) 


$22 C2I) 

512 cn%) 

$963 (•97%) 


$:12S (Lll) 
5^122 (10%) 
^935 (79%) 


IPotal ^ 


^12 38 (100%) 


$1018 (200%) 


^1182 (L0O%) 



'WBeca^sa cf rounding proo&duias ^ component axsendit-urei ao mot always add UB) 
praclseLj tss -the totaLs shovffi, 

M.1 gsr-piiiin- f dgujces ih.owr» in tbLs ta.ble wtfre caacii la-Ced across the tota3_ 
sc^hooL enc-cll.inents v t« a.ll(Sw direct oompariaona ofl p«r-puBll a3_lo cat ions Stom 
ai-fferent sources. Vfliin. avsraged across on3.y -thoss .students li.stea ly the 
iffhoaLs as ESAA. program paKrticipanta, the p«r-iupdl ES^ exp^naiture figujcaa 
atfe Amsmmdto $29L, $13P, and $2^2 reapechi-vsls f or the B4si.o ELoMSrttatfy, 
Basic S«ooi!dary^ and Pil.ot El«me«it«3y Saniples. Mave rtnoless , i-n tarMs of 
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Impact on. the total school exBandttures across th© wtira studeat body, it Is 
clear that thm ESAA fuads varo a ralatively smaLl p«rt of the schools' budgets. 
Xn the Basic Elemaiitary achoolB , for exainple, only one doHar per pupil cams 
from ESAA foi evary ninetaeri dolLars from other fundiiig sources. 

Also apparent in the table above is the dif ferertce among the tliraa samples In 
supplemental per-p-upil expenddturea . The lacgeat BSAA per-puplL eKpenditures , 
and the Largest supplemental expendituras from sources other than EShA, were 
in sample Pilot Blementary schools, while the swallast expenditures from ESAA 
and othec suppleniejital sources ware in Baaic Secondary ic^ools , 

Total 1974-75 per-pupil escpanditiarea in tha sample ESAA-paitio ipatiiig (treat- 
mant) schools were significantly higher than those in the pairea non-ESAA (cori- 
trol) schools, for all three evaLuation samplas. These differences , however , 
ware \isually only a small fraction of either of the two ejtpeiiditure figures 
being eottiparea. Purthemiore,. ,in tha Basic and Piaot Blaineiitary samplea, "there 
ware no signifiicont dieferences between the ESAA-partiGipating and non-ESAA 
schools in the allocatioiis of supplemental funds lor aGtivlties having apparent 
relevance to achievement or school climate (e.g., reading and math instruction, 
new curricula/ guidance and ■counseling, and Intergroup and cultural enrich- 
raant) , While ESm-participating schools' in the Basic Secondary sample spent 
significantly more than non-ESM control schools lor reading and tnatheniatics 
instruction, the size of these diffBiances (58 more pec pupil in reading and 
54 more for mathematics) makes their practieal ImportanQe dovbtful. 

SB RVI ffiS MLI^ RED 

3n both 1973-74 and 1974-75, iSAJ^-participating schools in all three evaluation 
samples spent the largest shara of their ESAA funds, and of other, non-ESAA 
funds, for instrTjction in reading and ntathematics , In 1974-75, for example, 
Basic Elenientary and Basic Sacondary schools focused roughly thrae-fourths of 
both BSA* and non-ESM fmda on instruction in these baiie skills, while Pilot 
Elementary schools devoted approKimately two-thirds of their funds for this 
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purpose, percejitage e^endituras for other services varied semevhat across 
samples* la Basic Eleiftentaty sample schools, for instance # the major areas of 
bath HSM. and non-KSA^ fl^^eaditures^ other thaa raaai3rtg and math Instriactioa, 
were niv curric-ula, amd adintnistrattve and auaclliaiy services. In the Basic 
Secojidaay mm^l^w W contrast^ the major expariciitiije areas (other than basic 
skills) for EShk tunds were Intergroup and cultural enrichment, and guidaanca 
and coujis^ling, while that for noa-BS^ funds career ediica'tion. 

As in 1973-74^ the rasults for 1974-7 S sho^ that resovrcea an J secvicas ware 
targeted to naady ichcol aistaeicts ^ echooLs^ aad students, ESM. grants, as 
noted ajjov^er were awarded to districts hav^ing Large percentages of students 
with acuta needs for compears ato ay education (i,e^, lov scores on standardised 
achieveBient tests) and witli lo^ socioeconomic Levelsi these districts, in turn, 
directed ESM funds to idiools that had high proportions of aeadamically timBdy 
and financially disad-vanta^sd students, h strong relationship betv^een the nfeed 
for campensatory sarrices and tiie targeting of ESA^ resowces v?as shown by 
significant ccrrelationi he^wemn achievement teit scores and EShh ejcpenditures i_ 
in gemral, schocli having the greatest need (I.e.* the lovest reading and 
mathecnatles pretest scores) had the highest Levels of ESAA per-pupil expenditures. 

^Idence also shows that supplementaL funds including ESAA ej<penditures vare 
translated into basic skiLls instruction a^ other snppLaaiental services that 
ware targeted toward needy^ students. In all three evaluation sampLes, students 
with greater needs for cciE^ensatory education <i .e. , lowr pretest achiev^eoient 
scores) tended to rscalve greater anomts of instruction in reading and mathe- 
inatics than Lass needy students. TOits trend was further corroborated by analyses 
of rasource-utillgation data collected in 24 of the smple schools constituting 
the' In-Depth Study* sample. On the average, Glassroom teachers in echooLs with 



*TOis stiidy ii more ffult^ descrihea irwellisch, B. , Marcus, 
HacSnaan. ^. H. , and mek, G. h. An In-Depth St udy of merqency S aho ol Ud 
Act (BSA^) schools I 1&74-1&75, 36/010/^00, By stein Development CorjpoMtion, 

July, 17976^: 



17 



11 

motm neady stxiaejits flewted moxm ti^ *o ^aading and math inattfuetioiip laaliidiftg 
lesson plan pieparatlon^ than t^aeheci tn sehMla ^ith'ieis needy studiiita^ 
SimlLaElys. the mmomomm aLloeattd t© yeraedial reading aad math specialists ^ 

to inservloe trstniftg for class roeni teaaheM, wwm graataff in needy sahooli 
than in the less needy sehMli * 

to siamwy^ eT^ldenee frsm the ilfst tw© years ct prograia jrapl^satrntion (1973-74 

1974-753 Indiaates C^) that thm mBm> xmBowcmm aia©€atioft jpreoisa sucMSS- 
f^lly dlapensea funds t© dtifcrlsts vitt needy gtud^ts, Cb) that those dtitriGha 
in turn allocated MftA. ffimdi tc ne^y Bdhmlm^ and (e) that the Malpleiit 
schools ttMislat^ the ffunai wt© aesded aarvicei and targeted those sewices 
tward students wiUi acute needs ecmpensatery edusatlon programs* 

noomM IMPACT 

m tihe first evaluatioii yew (1973-74) i there was little evidence ©f sulist^fttlal 
differences Lit prograni resourees ©r aeivices between the ESAA-fwded Ct^eattient ) 
ichOQls and the noii-lS^ (control) iahcola. For thi^ reason, because the 
saniple studerits had received only ahoat five mA a half months' es^aure to 
MAA programs that were still in thalr initial implinentatlon phase, it cads 
a.m no sujrprlse that there wm no e\fide3iae ©f ESAA. program ImpaQt, i.e., th^t 
M treatment-CQUtrQl dlfiferences in aohievement test gains were found, 

lairing the second year (1974-75), tiiere were tndicationa of a possible tresid 
tcv^ard larger differencei in total fmding between ESAA-partioipatlag and ricin- 
mhk schools, though allQeations im activities saemingly relevant to the ciit- 
cesia meaiwes were still similar ior the two groups ©f schools* Again , th#re 
was no eleaaf svidanoe oC ISAS progcara impaat, on ai^er test score gains oy 
gains ia school cllmata meaatiraa. Within the Basia lleaientary aample^ tri#t- 
mat (ESAA-funded) schools made larger gains thaa eoiitrol (non-BSAI^) sohools 
ill boOi reading tod mathainatici , and In all three grade levels sampled. Despite 
the consisteacy in diraction &i Uiese findings i however, none o£ the diJtfeseneea 
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was statisticalLy significant* ThuSr it will lnijporta.nt in subsequent anal- 
yses to eHmLnm res^iLts for the thiid e\ralaaticn year (L97S-76) detenaine 
whsthar ths apga-reTit trends towaJa gtiata^ teaatmen t-coatrol diff^reiiees in 
resources and la outaomes increwed Ln the final year off the evaluation. 

AdditionaL amalyses^ were performaar uiiag riat:ional tei^ notins ratlier than th€ 
control (non-ESM) ichools as a benchmark for evaluating achieveMnt gaias q£ 
the ES^-particlpating schools, assifflnptlM underlying thsse anal^iea was 

that ESAA might be considered succsssf^l itt m scho&l if^ on tha averaga # ESAA^ 
participating studanti in that school eicceaded the te&t score faina leqiiired 
during the schcol y^ear to maintain thiir same ranking lelati^e tc> the nation's 
total populatian of sttjdants (as rajprasented by the sMnple used to daval&p the 
publishers* no:rming tahlas) . For aKamyle / if a test score gain ot 17 pcints 
wera required -to maintaiji a school*! ianitial ranklrig at Uie 20th percentile, 
and If the sampla ESAA-partlcipatiag students in that sahool had an avaarage gair) 
ot 23 points, the ESAA program in that school would be clasaifficd £ox piirposas 
of these analyses as iiaocessful* 

Results using this definition of success vard^ with ^xma^ laurel and suhjact 
aiea. Overall, howave^r, about mn of the Pilot Elesnentary aiid Baedo mUrnQntamy 
schools met the success criterion in rasding , and almost 15% of the schools in 
those sampLas met the criterioii in matli. In the lasle Secondari^ sanple , about 
30% of the schools met criterion to oa^thr there wm^B no appropriate nonns in 
scQondary raading for determining the jimlser of schools "suoceisfful" In that. 
Gcatent area. In genaral^ them, thesfe tsiults sftem to presiiit a soiaa^hat more 
positive pictu:ce of the ESaA--paE:ticipa.tlng itadents* parfcrttiance than do the 
t^eatmant^cont^ol comparisons. It should be not&d^ hot^ever, that the arlterion 
of success used hera^ based on national test noMks* is mmmwyimt arbitrary, anfl 
subject to differing intarpret^tima .icc&^diiig to one's eacpftctations regarding 
the effects of compensatory education pTOgrasis* 
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For thm aj^lorator/ analyses reperted hevm , 197 4-75 data from ES^-fujided 
(treatment) and non-'ES^ (control) schools were oombiried, sinca tKe purposa 
was to determine what progrm £eat\^es ^mre associated vrith succesifful out- 
commB f regardless of funding sources fo^r those prograins* relationship^ 
dLacovered Ln thase analyses though somev^at tantati^e, suggest a nimbtt 
Important interaetioni that have policy implicatiojis for ESAA and similar 
educational programs. 

Before proceeding further, it shctald noted that the relationships aanisiarisad 
^elovf represent general trends , Tsat \/ere not al^ay^s found at ev^ery grade level 
or for every subtest. Readers iiitarested in greater details of tha findings 
ara referred to Wie source dooimants Hated at the beginnijig of this suminary 
report* 

^o sets of relational analyses vera perforrned. first sat used data from 

all of the 1974-75 BaEnple districts and schools, while the second set wras basod 
on a eiabswple consisting of 24 alainentary schools used in the Ixi-Depth 
Study. Hhm In- Depth Study supplemerited the overall ESAA evaluation, and was 
desired to meet the U.S. Office of Education's requirement for a xnora detailed 
and compreliensive aKaMination of prograin operations at schools seleotea to cDver 
a fairly vrida range of effectiveness in raising students* achiev^einent levels** 
A nuniber of spaclal analyses were possible for the 3n-Depth sites because of 
the lAse In those schools off intensiva classroom obserirations and intarviews , 
as ^ell as the qnastlonnaires and tests used in all other sample sites^ 



*Tha detailed report of mm 3n-Depth Study is seeferenced in the £ootnot& on 
Paffe 12* 
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Considartng first the results from the total samples of districts and gehools, 
the Basic and Pilot Elementary samples showed larger laadiiig and mathematics 
gains in sites with higHBr regular (district-suppoited) per=8tudeiit expaiiaitures . 

Similar though somewhat weaker relationships were founa batwaen total (regular 
plus supplemantal) per-studBnt axpenditurss and aclile-vement . Also, in the 
Pilot Elementary oampla, larger mathamatics gainB were aaaociatad with graatar 
supplemental expenditures for mathematics instruction , ana were also (though 
less strongly) relatad to greater eniphasia on drill and practice procidares in 
the math instruction. In the Basic Elementary saitipla, there was a tandency for 
laiger reading gains to be aGSociated with more recent teacher insarvice train- 
ing in reading instruction, 

Several significant relationships were found between achiavement scores and 
program characteristics in the Basic Secondary sampla. Larger mathematics 
test gains were associated with larger amounts o£ instriictional time in mathe- 
watics, with more highly trained ma thflmatics teachers, and with snaller pupil- 
to-teacher ratios. Mso at the secondary level, laiger reading gains vJore made 
W students in districts that undertook more activitiis designed to facilitate 
arid support school dasegragation. This latter finding is particularly important 
jjBCause o£ its similarity to relationships found in the first evaluation year 
(1973-74) at the elementary level. 

Policy-relevant relationships were also found with respect to certain tnaasures 
■ of the students' perceptions of school climate Ci.a., perceptions of teacher- 
student, prinoipal-studant, and stadent-atudant Interactions, perceived school 
discrimination,, feelings off alienation:). At the eLementary level (Pilot and 
Basic sampLes) , several climate Indicators showed more positive gains (improved 
climate) where studants expreasad a liking for school and where they parcelved 
their teachers as supportive, in the Basic Secondary sampla, less fealing of 
alianatioii was reported by students im schools where the sample teachers reportad 
positive attitudes tow^ard desegregation* 
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toalysas basad oti tha In -Depth Study samjLe of 24 elflmontary ichooLs yielded 
addttionaL fLnalngs of consldecabLe importance for ISAA progcain poLicy formula- 
tion, In theiB analyies , alamen-tary schcols founa succassf-ul in readiTig or 
math (as indLcatea by their gains in percantLle rankings over tha school yeax) 
were comparea with a doinographicaLly simlLar gKoup of BChools that ihowad lam 
success in laading or math. The major dimerislons on which comparisons wera 
based weie the schools' organiaational cltmata, parental and commuriity Invol^ra- 
wentj reaairg aad math instructional practicei and relatefl teacher attitudes j, 
reaaiiig and itiath. iiistructional reaourceB , and eqtuallty &f adueational opportuttlty. 
In-Depth StvAy reBalts in each of these areas are sijinfflarlaad b«low. 

PareAt aiia_Cc»mni\inity_ liiyolvement 

Two major issues ware iavastigBtad in the aiialysis of pareftt and commiinity in- 
volvenant at school, first issnia was tlia dBgree to which parent involve- 

inent was assooiated with certala promotLonal activitias designed to increase 
active pacaiit participatloa . Kane cE the promotional activities exainined irx 
this stu.dy (e.g., holditig open h0tjs«, providing evening entertainment, distri- 
tutlag school aieWsletters) was fomd associated with parent participation. How- 
ever, parents ^are more involvea in aohools where the principal assunied more of 
the responsibliity for establishing- policy in the area of scliool-community 
relations . 

Ihs second iss-ue involved the relationahip batwaen, parent paiticipation and 
studant achievemerit , Schools -ware sigjiifleantly B^ore likely to show- math 
gain— that im, their students -were mora liteely to improve their standing reU- 
tive to the natioii's student pcpulatlon — •when parents ware present in the clftBS- 
rooins as paid instructional aides, volTinteers, or visitors, fflie relationshiip 
to reading ach.ieveinant was also pcaitiye, though not statistically signlCicariit . 

. It Is impoEtaat to note that this eelatioiiship between parent involvenient mn4 
student outeonies ws quite spacifio to parent participation in the classEoow,, 



22 



16 



Appartntly the use of ron-parent aides did not have a comparable association 
witli sti^ents* achievainant gains, nor did parent participation ou-tsida the 
classrcsDin (e.g,, as clerksr or on advisory cominittees) * 

InstguctionaL ResQitfces Used in Reading and Mathamatics 

Reading and math resou^ees v&tm analysed in terms of class size, dastriactlonaL 
tlnie in reading and ma staffing practices , equipment and materla.ls, tnsarvice 
training, and teachers' education. The allocation patterns of these raao-urcaa 
among the successful and less successful elementary schools ra^fealed two 
relatimships with students' gains in mathematics* First* ichcols ^ere slgnifi-^ 
caatly nwre likely to toe successful in raising math achlevafflent whan mere of 
theit resources were allocated to remedial specialists in math. The same trend 
was obtained for raading achievement, though the results v?ere not statistically 
significant. Secoad^ schOQla vrere significantly less likely to be suocessfful in 
rsLsing inaUi achiev^enient vhen more of their resources were allecated tc math 
instructional aides (as ooatrasted with remedial specialists) . 

Reading and Mathainatleg Instructional Practices , 

l^lle several variables related to the teachers' classroom pTOCelii«s and attl- 
t^fles vere found to be associated with adilevament gains in the ln--Depth sample 
schools p the most consistent and Intaj^retabla involved the teachecs ' use of 
behavioiral objectiv^eSr and ttielr use of struaturad practice sessions , 

to index cf the use of behavioral obje ctives was significantly^ asaociatea mth 
hcth reading and matli gainsi that is, schools were more Likely^ to show achieve- 
iment gains when teaohers organisged their instruction areand lesson ohjectives 
deCined In terms of specific skills and knowledge to be masteted by the students 
The tehavioral objeatLves index was defined in such a mariner that it would have 
SL high value when teachers (a) maintained stiident records that showed attalament 

specif Ic Instructional objectives, (b) placed a relatively high ^alu€ on the 
Ilia of behavioral objectives , and (c) placed strong emphasis on revising lesson 
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plans (rather than abandoning objectives) when instructional objectives were 
not attained . 

Schaols were also more likely to show reading gains when practice s essions were 
observed to iriclude many of the steps necessary for mastery of the lesson ob- 
jectives, and when the sessions were relevant to the lesson objaGtive (ohserver 
judgments). Wo relationship was found with math achiavement gains, 

A third reLationship—or aGtually, a cluster of relationships— is of great 
potential interest, but is also more difficuLt to interpret than the two find- 
ings cited above. Schools whose teachers frequently praised the students were 
significantly lass likely to maka gains in readingi there was a similar but 
non-significant relationship in mathematics, Mthough this finding seems sur- 
prising at first, it can perhaps be explained by the relationships found between 
frequency of praise, and several other teacher behaviors and attitudes. First 
of all, there is some evidence that the praisi ^as given somewhat non-selectively . 
That is^ students tended to receive praise regardless of whether they were eK- 
hibiting desired behavior (e.g., giving correct responses to questions). It 
has long toean recognized that feedback such as praise must be used selectively 
to he effective* Secondly, teachers giving more praise tended to stress psycho- 
emotional goals as mora important than academic goals, and also tended to give 
the studeiits less practice time. Thus the evidence, while somewhat tentative 
and circumstantial, suggests that extensive use of praise rnay have impeded 
academic growth by de-emphasizing a task-oriented approach to instruction (e*g. , 
providing practice time or, informing students of their weaknesses as well as 
their strengths). 

Or( ^anizatlo!ial Climate 

diinenaions of organisational climate were found significantly related to 
achievement gains. The first was an Indejc ntf administrative leadership in the 
school f sohoola characterized by strong administrative leadership were 
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eignifiaantly mora likely to raise wath achiavement and soMwhat more likely 
to raise reading aehievewant. For purposes of this malyais, a school was 
rated high on aitoinistratAve leadership {a) when its aaministrators assraied 
respDnsibillty for salacting basic instructional materials, (b) when the 
prinoipal attributed aonglderable itnportanoe to decisions regarding the selec- 
tion of basic instructioMl inatarlals/ and (c) when teachers in that school 
more accurately percaivad the pririclpal's attitudes regarding various instruc- 
tional practices. Thus, thm administrative leadership measure applied here 
was specifically and direQtly conoerned with the instructional process, 

toother finding in the analyses of organimtional climate was that schools ware 
si^ificantly more likely to show math gaini where greater district- level sup- 
port for new teacher 3 was offered* Orlantation eourseSf insarvice training, 
and doeumentation of proa^dures vimrm thm most coiranon forms of teacher support 
at the district level. 

Equality of Educational Opp ortunity (SEP) 

Equal treatment for students of all racial/ethnic groups is the law of the land, 
and requires no justif ic^l^ion on the basis of possible effects on student aohieve 
mant. Nevertheless, it sterns worth nDting that, Mong the desegregated (Basig 
Elementary) schools in thi^ In-Depth sample for which adequate EEO data were 
available, reading achievi^ment gains \/ere significantly less likaly to be fomd 
in schools whose teachers were observed directing a disproportionate amount of 
negative feedbaGk toward minority students (e.g., pointedly ignoring the students 
criticising them, or sending them out of the class) . 

Other relationships of interest ware found among the various EEO variables 
themselves. For axample, schools with segregated seating patterns were less 
likely to have student intargroup miKiiig dicing recess and lunch than ichools 
without such patterns. In addition, schools that used fewer multi-^ethnic in-- 
structional materials also tended to have sagregatad seating patterns # and the 
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ttachera in those schools tended to asdilblt disproportionately more negative 

behavior (eriticisini ete.) toward minority studants* Finally, students' per- 

captions of the ^allty of teacher--student intaractions tended to be less 

favorable in sohools where teachers were observed to direct disproportionately 

large amounts of negative behavior toward minority students. In short, the 

individual elementary eohools in the In^-Depth study appeared to rafleot a ? 

oonsistent sohool-lavel pattern # favorable or unfavorable, that out across 

several dimehsiona of EEO* : • 

In reviewing the results of the relational analyses — those using data from the 

entire sample as well as analyses based on the ssnnaller In-Depth subsarnple^-^it 

should be reoognized that the findings are still tentative. Sample siMS for 

certain analyses, espaGial=L.y those associated with the In-^ Depth Study, were 

small. Furthermore, neither schools nor students were randomly assigned to ■ 

the various program approaches being compared. Rather, these analyses, unlike 

the impast analyses, depend upon naturally occwring inter-site variations in 

program approach. TOus, outcome differances attributed to certain program ' ' 

variables may in fact have resulted from imcontrolled variations in other 

charaateristios of the districts or schools whose programs are being ©Kamned^ 

Nevertheless, while any particular relationship desoribad above might be spmrious # 
the total pattern of relationships strongly suggests an important conclusion t 
that sahool progrM characteristics did make a difference in student achieve- 
ment. At the risk of serious ovar-'Simplification and over -generalisation/ the 
more pervasive trends in the relationshipa discussed above may be summarised . 
as follows I 

m Results of several analvsas suggest that program fundi n g and resourcas 
can make a difference^ particularly if they are applied to activities 
directly related to the outcome ineasuras of concern . In the Pilot 
Elamantary Sample, larger math gains occurred in schools with larger 
supplemental expenditures for mathematics instruction, while in the ; ■] 
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Basic Saconda^ Sample, larger math gains were associated with smaller 
student-to-teacher ratios (i*e,, with a larger staff relative to student 
enroliment) . Both the'Baaic and Pilot Elemental samples showed larger 
reading and mathematics gains in sites with larger regular (district- 
supported) per-student expenditures. In the In-Depth Study sample, 
schools were more likely to be successful in raising math achievement 
when more of their resources were allocated to remedial math specialists 

A greater degree of Instructional program focus and structure appears 
to aid the a chievement of Iwachleving, disadvantaged students such 
as those i n the ESAA-participating schools . In the Pilot Elementary 
sample, larger mathematics gains were associated with greater emphasis 
on drill and practice procedures in math instruction. In the In-Depth 
Study sample, there was a greater probability of reading and math gains 
in schools that made use of behavioral objectives to guide their instruc 
tion, and in schools that provided practice sessions to ensure mastery 
of those objectives. Conversely^ schools where teachers gave frequent 
and apparently non=selective praise wero less likely to show gains in 
reading achievement? this relationship can be interpreted as indicating 
the need for careful structuring by teachers of all aspects of the 
teaching-learning process, including the use of praise and other rein- 
forcers* Finally, gains in both reading and math achievement were more 
likely to occur in schools whose principals provided focus and struc- 
ture, in the form of strong administrative leadership. In particular, 
achievement gains tended to be associated with principals who were 
personally committed to the selection of appropriate instructional 
materials for their schools, who exerted strong influences on the se- 
lection process, and who communicated clearly and unambiguously to the 
teachers their own attitudes about how instruction ahquld be conducted. 

parent involvement can apparently be beneficial to student ac hievement, 
when those parents are present in the classrooms as paid instructional 
aides, volunteers , or visitors . This effect seems not to generalize to 
the use of non-parent aides, or to parent participation outside the 
classroom, 
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% Efforts to Improve interracial climate and attitudes ^ while desirable 
in their own rights y evidently have be n efic^ial ejfects on achievement 
as we ll. In the Basic Secondary sample, larger reading gains were made 
by students in districts that undertook more activities designed to 
facilitate and support school desegregation; a similar relationship 
was found in Year One at the elementary level* In the in^Depth Study 
sample, reading achievement gains were significantly less likely to 
occur in schools whose teachers directed a disproportionate amount of 
negative behavior^ such as criticism, toward minority students* 

CONCLUSIONS 

The combined data from the first two years of the ESAA evaluation show clearly 
that dollars have been targeted toward needy school districts, schools, and 
students; further, those dollars have been translated into services directed 
toward students with needs for such services* This finding is important for 
two reasons* First, it implies that the ISAA resource allocation process is 
functioning as intended — ^a statement that could not truthfully be made about 
many other compensatory education programs in the past. But at the same time, 
it raises questions about why a program so appropriately targeted should have 
yielded no solid evidence of overall impact (i,e*, impact assessed by pooling 
across sites) on student achievement or school climate. Of course, in any 
evaluation, the outcome measures used as criteria of program success may be 
insufficiently sensitive to changes that might have been fostered by that pro- 
gram. However, the achievement tests used in the present study, while not with- 
out their deficiencies, were carefully selected for their appropriateness to 
the study "S purposes - 

h more convincing escplanation for the apparent lack of ESAA impact lies in the 
fact that, possibly because of the sample districts* freedom to adjust their 
allocation of other federal and state program ftmds among the various schools, 
the ESAA participating (treatment) schools often did not differ greatly from 
the paired n^i^ESAA (control) schools with respect to the total per-student 
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funds allocated for ESAA-relavant activities. Though the differences appeared 
greater in the second year of ESAA implementation than in the first, most were 
still of modest size. Nor was a pattern of large or consistent differences 
found between ESAA-participating and non-ESAA-partiGit /.ing schools in the 
services offered to their students. Thus^ the antiGipated clear-cut treatment 
differences between ESAA-participating and non-ESAA sohools— differences on 
which the expectations of outcome differences v/ere based--largely failed to 
materialize. Nevertheless^ there are definite indications that some local ESAA 
projects were quite effective^ but that the successes of those projects were 
obscured in the overall impact analyses by the failures of other projects. When 
data from both ESAA-participating and nQn-ESAA schools were combined^ and 
differences in funding source were ignored, certain program characteristics were 
found to be associated with more favorable outcomes. While the strength and the 
ganeralizability of the evidence favoring particular program approaches varied 
considerably, it appears that the more successful programs were ones in which 

m greater expenditures and personnel resources were focused on activities 
related to the evaluation's outcome measures (i*e., basic skills and 
school climate) , 

0 there was stronger and more assertive administrative leadership, par= 
ticularly with respect to instructional materials and policies, 

« lessons were more highly structured, with teachers using praise very 
selectively, and making greater use of behavioral objectives and of 
practice sessions targeted toward those objectives / 

0 parents were more heavily involved in the classroom, and 

# efforts were made by teachers and administrators to promote positive 
interracial climate and attitudes. 

It should be emphasized that all of the findings reported here are somewhat 
provisional, as the data for the third evaluation year (1975-76) have yet to be 
analysed. When the 1974-75 data were compared witih the 1973-74 data, there 
appeared to be a trend in the second year toward slightly greater expenditure 
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differences between ESM-participating and non-lSAA schools , anclf in dartain 
cases I toward greater achievement differences as well. Thus thm third-year 
data and longitudinal data will be closely eKamined in the next report for 
more positive signs of EBhA impact, Another major focus of the Year Three 
Report will be to seek verification of relationships found in 1973-'74 and 
1974*75 between program charaoteriatics and outcomes. Such cross--year verifica-* 
tion would increase the confidence that can be placed in those relationships # 
and would permit stronger recommendations to be made for future program improva** 
ments , 
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